Incompleteness of the Thouless, Anderson, and Palmer mean-field description of the 

spin-glass phase 
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We analyze the low-temperature behavior of mean-field equations of Thouless, Anderson, and 
Palmer (TAP). We demonstrate that degeneracy in free energy makes the low-temperature TAP 
states unstable. Different solutions of the TAP equations, independent in the TAP approach, become 
coupled if an infinitesimal interaction between them is introduced. By means of real spin replicas we 
derive a self- averaging free energy free of unstable states with local magnetizations and homogeneous 
overlap susceptibilities between different spin replicas as order parameters. We thereby extend the 
TAP approach to a consistent description of the spin-glass phase for all configurations of spin 
exchange with (marginally) stable and thermodynamically homogeneous free energy. 
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I. INTRODUCTION 

The Parisi replica-symmetry breaking (RSB) scheme 
Q was proved to be an exact solution of the Sherrington- 
Kirkpatrick (SK) model of spin glasses Q. The analytic 
form of the mean- field theory of Ising spin glasses is hence 
known. What has not yet been unambiguously identified 
is the physical origin of the order parameters from the 
RSB solution of the replica trick. The replica trick is used 
to allow averaging of free energy over random configura- 
tions of spin couplings. Thermal and disorder- induced 
fluctuations are summed in the replica trick simultane- 
ously via a single averaging of an n-times replicated parti- 
tion function. One is hence unable to determine whether 
the former or the latter fluctuations give rise to the order 
parameters from the Parisi solution. To find the phys- 
ical origin of the order parameters of the RSB solution 
one must separate the thermal and the disorder-induced 
fluctuations. 

The direct thermodynamic approach summing sepa- 
rately the thermal fluctuations for fixed typical config- 
urations of spin couplings Jij in the SK model was pi- 
oneered by Thouless, Anderson, and Palmer 0. The 
standard TAP theory of the SK model contains only lo- 
cal magnetizations as order parameters. The averag- 
ing of the TAP free energy over random configurations 
within linear-response theory and with the fluctuation- 
dissipation theorem leads to the (replica-symmetric) SK 
solution unstable in the low-temperature phase 4]. That 
is, no Parisi RSB parameters emerge directly in the TAP 
theory. 

The assumptions made for the averaging over ran- 
domness in the TAP theory are essentially equivalent to 
uniqueness of the equilibrium state for each relevant con- 
figuration of spin couplings. It appeared rather soon, 
however, that the TAP equations display a multitude of 
solutions in the spin-glass phase [Ej resulting in a com- 
plex free-energy landscape of quasi-equilibrium states @ . 
The existence of multiple solutions of the TAP equa- 
tions would not pose a problem if different states were 



distinguishable by symmetry-breaking fields introduced 
in free energy. The solutions of the TAP equations in 
the spin-glass phase are highly degenerate in free energy 
and cannot be singled out by external fields. Even worse 
is the fact that for a large number of configurations of 
spin couplings there are no stable states, local minima of 
the TAP free energy 0, Q . One hence cannot define a 
unique macroscopic thermodynamically stable state for 
these configurations. The existence of an exponentially 
large number of solutions of the mean-field equations has 
become a hallmark of spin-glass models. A new branch 
of research on complexity of solutions in the mean-field 

theory of spin glasses emerg ed Banana. 

The nonexistence of thermodynamically stable macro- 
scopic states for majority of configurations of spin cou- 
plings hinders the existence of the thermodynamic limit 
in the TAP approach. To circumvent this problem De 
Dominicis and Young suggested that the equilibrium 
state in the TAP approach be defined as a weighted sum 
over different TAP solutions |l2( That is, one assumes 
that the partition function can be represented as 



Tr s exp [-/?#{£}] 



exp[-(3F TAP {mf}] , (1) 



where A/" is the number of TAP solutions labeled by su- 
perscript a. Assumption means that the phase space 
of the SK model is effectively disconnected. It consists of 
pockets of spin configurations corresponding to different 
TAP solutions separated by impenetrable infinite energy 
barriers. 

Albeit assumption Q defines a relation between in- 
dividual TAP solutions and the macroscopic thermody- 
namic state, it does not introduce the RSB order pa- 
rameters. They emerge in the De Dominicis and Young 
completion of the TAP theory when the replica trick for 
averaging over random configurations of spin couplings 
is used. Without averaging over randomness we are able 
neither to verify Eq. nor to trace down the genesis of 
the RSB order parameters beyond the replica trick. 
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Averaging over randomness should not generally be 
the eventual tool for introducing the RSB order parame- 
ters. Guerra and Toninelli recently proved that the free 
energy of the SK model is self-averaging 0] . Should the 
TAP approach be exact, one had to trace down the Parisi 
order parameters within the TAP approach without re- 
sorting to averaging over randomness. A question then 
arises whether the TAP construction indeed provides a 
complete description of the thermodynamics of the SK 
model. 

We know that to derive the TAP theory we have to as- 
sume uniqueness of the thermodynamic equilibrium state 
described by a set of local magnetizations. This, how- 
ever, is the case only if a convergence condition for the 
linked-cluster expansion 

i£^r£(i-™?) a ( 2 ) 

i 

holds 0. Equality in the above condition determines 
the de Almeida-Thouless (AT) line separating the high- 
temperature from the spin-glass pha se along which the 
spin-glass susceptibility diverges Condition (0) is 

broken below the AT line for a macroscopic portion 
of spin-coupling configurations and the TAP free en- 
ergy does not have an adequate (rigorous) justification 
there. We must continue analytically the TAP thermody- 
namic potentials from the high-temperature phase, where 
Eq. J2J is obeyed, to the low-temperature one, where the 
latter condition may be broken. Such a procedure is not 
uniquely defined, unless we have appropriate symmetry- 
breaking fields at our disposal. Presently, it is assumed 
that there are only local magnetic fields, Legendre conju- 
gates to the local magnetizations, as symmetry-breaking 
forces. The TAP free energy in the spin-glass phase con- 
sequently has the same form as in the high-temperature 
phase, i. e., it is described by the same order parameters, 
local magnetizations m^. 

Recently Plefka suggested that the TAP equations in 
situations with unstable states where Eq. @ is broken 
should be stabilized by introducing a new " order param- 
eter", a correction to the local magnetic susceptibility 
beyond the fluctuation-dissipation theorem . Plefka's 
extended solution, however, does not allow for a diagram- 
matic representation, the order parameter for the devia- 
tion from the fluctuation-dissipation theorem cannot be 
derived from free energy, and hence a physical meaning 
cannot be given to the calculations containing the TAP 
solutions breaking condition J2J. Although the unstable 
states seem to become marginally stable in the thermo- 
dynamic limit |l7l | , the number of states breaking condi- 
tion © linearly increases with the number of lattice sites 
and diverges in the thermodynamic limit la,!?). Unstable 
states from large but finite volumes hence remain statisti- 
cally relevant also in the thermodynamic limit, since the 
negative values of the r.h.s. of Eq. Qvanish with power 
N~ 2 / 3 0,EJ. We hence cannot disregard or inappro- 
priately treat the finite-volume unstable states without 
further considerations. We can deduce that the number 



of TAP configurations with unstable states is macroscop- 
ically relevant in the thermodynamic limit also indirectly 
when averaging the TAP free energy over spin couplings 
Jij . Using linear response and the fluctuation-dissipation 
theorem, equivalent to self- averaging property of free en- 
ergy of ergodic systems, we fail to produce a thermo- 
dynamically stable equilibrium state in the spin-glass 
phase. Since we know that the exact free energy of the 
SK model is self-averaging, the TAP construction breaks 
down in the spin-glass phase. To attain a self-averaging 
configurationally-dependent free energy we must extend 
consistently the TAP free energy also to configurations 
with unstable states, i. e., beyond the validity of inequal- 
ity ©. 

The aim of this paper is to demonstrate that the TAP 
free energy becomes unstable whenever stability condi- 
tion @ is broken and the TAP equations do not have a 
single solution independent of the initial conditions. By 
using spin replicas for portions of the phase space be- 
longing to different TAP solutions we show that linear 
response theory is broken when an infinitesimal interac- 
tion between different spin replicas (solutions of the TAP 
equations) is introduced. This breakdown generates a set 
of new homogeneous order parameters, overlap suscepti- 
bilities between different replicas. They lift degeneracy in 
the TAP free energy and break independence of different 
solutions of the TAP equations. We derive a generaliza- 
tion of the TAP free energy for one configuration of spin 
couplings containing site-dependent local magnetizations 
Mi and homogeneous local overlap susceptibilities x ab as 
order parameters. The latter are directly related to the 
RSB order parameters of the Parisi solution. In the para- 
magnetic phase x ab — an d we recover the TAP free 
energy. In the low-temperature phase, for configurations 
of spin couplings for which condition J2} is broken, the 
overlap susceptibilities become nonzero and we observe 
macroscopic deviations from the TAP free energy. Dif- 
ferent solutions of the TAP equations are hence not sepa- 
rated by infinite energy barriers. Mutual thermodynam- 
ically induced interaction between solutions of the TAP 
equations mediated by the overlap susceptibilities inter- 
connects parts of the phase space separated in the TAP 
theory. The phase space becomes simply connected and 
stable macroscopic thermodynamic states exist for each 
configuration of spin couplings independently of whether 
condition is fulfilled or not. The interaction between 
different TAP states also leads to the existence of a sin- 
gle equilibrium state with a well defined thermodynamic 
limit generated from a self-averaging free energy func- 
tional. 

The paper is organized as follows. In Sec. [H] we re- 
call the basic ingredients of the TAP theory with restric- 
tions on its applicability. We use real replicas and the 
demand of thermodynamic homogeneity to extend (ana- 
lytically continue) the TAP approach to situations with 
unstable TAP states in Sec. IIIII In Sec. IIVI we reduce 
the general theory to one hierarchical level and present 
the modified TAP equations, study their stability and fi- 
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nally demonstrate explicitly near the critical point that 
the TAP construction indeed becomes unstable in the 
spin-glass phase. In the last section we summarize our 
findings and discuss their consequences. 



II. TAP MEAN-FIELD THEORY AND 
STABILITY OF ITS EQUILIBRIUM STATES 

We first recall the basic concepts of the TAP the- 
ory for the SK model so that we understand the re- 
strictions under which the TAP theory is applicable. In 
the diagrammatic representation the TAP free energy 
was derived as a sum of tree and single-loop (cavity- 
field) contributions with specific restrictions of the SK 
model on spin couplings J^ , namely Y]. Jf™ +1 — and 
Y2j Jfj = J 2 13 • Due to the fluctuation-dissipation the- 
orem the local susceptibility containing the loop contri- 
butions is a function of the local magnetization and the 
TAP free energy for the SK model is a functional of only 
local magnetizations m^. It is convenient to represent the 
TAP free energy in the following form 

Ftap = £ |m i7? ° - i In 2 coah\J3(h + ???)] } 



It. 



Jijmimj + -(3J 2 (1 - m?)(l - m|) 



(3) 



where we introduced apart from local magnetizations mi 
also internal inhomogcneous magnetic field rft. The sets 
of parameters rai and ijf are Legendre conjugate variables 
and are treated variationally in free energy ©. That is, 
they have to determine an extremal value of this free- 
energy functional. The corresponding stationarity (TAP) 
equations for these parameters read 



m, = tanh[/3(/i + 77°)] 



5>4(l-mf) 



(4a) 
(4b) 



These equations can now be solved numerically for fi- 
nite numbers of lattice sites and given configurations of 
spin couplings. But not all solutions of equations Q are 
physical ones. Only locally stable solutions for which the 
nonlocal susceptibility does not contain negative eigen- 
values are meaningful. The inverse of the susceptibility 
is defined as a second derivative of free energy © 



d 2 /3F 



TAP 



+ 



l i drriidmj 
d 2 pF TAP difi 



dmjdrji drrii 



f E 

1 

+E 



I 



d 2 i3F TAP d v f 

drriidrji drrij 

d 2 l3F TA p drg drf 
drfydrji drtii drrij 

E«a-W)) 



(5) 



That is, only local minima of the TAP free energy as a 
functional of local magnetizations mi, when the internal 
magnetic fields are resolved, are physically acceptable. 

Non-negativity of the eigenvalues of the linear sus- 
ceptibility is not the only stability criterion. There is a 
stronger condition on consistency of the TAP theory. It 
is connected with the existence of a non-degenerate equi- 
librium state, an assumption used in the derivation of 
the TAP free energy. This condition is expressed as pos- 
itivity of the spin-glass susceptibility xsg- It is easy to 
find by summing the leading-order (A -1 ) diagrammatic 
contributions |5j that the spin-glass susceptibility has in 
the SK model the following representation 



1 E- 

N ^ 1 



2 

y ^33 



(6a) 



This representation of the spin-glass susceptibility was 
derived diagrammatically but it is valid quite generally 
as long as the r.h.s of Eq. (|6a|) remains nonnegative, that 
is if 



i>E^ 2 4^ 



(6b) 



We show in Appendix 1X1 that representation Ij6a(l can be 

derived also non-perturbatively using a theorem of Pas- 
tur and continuity of the resolvent for the inverse nonlo- 
cal susceptibility. 

Realizing that the local susceptibility in the TAP the- 
ory reads 



Xii = 1 



(6c) 



we find that the stability condition from Eq. © equals 
the condition on positivity of the spin-glass susceptibil- 
ity, Eq. (|6b|) . Positivity of the spin-glass susceptibility is 
a feature that each consistent solution must possess. If 
it is broken, then the phase space of the order param- 
eters is incomplete and some relevant fluctuations have 
not been taken into account appropriately. Note that in 
general positivity of the spin-glass susceptibility does not 
coincide with positivity of the eigenvalues of the nonlocal 
susceptibility. Only squares of the eigenvalues of the lat- 
ter contribute to the former. The spin-glass susceptibility 
may become negative even if the linear susceptibility is 
positive, that is for a local minimum of the TAP free 
energy. 

The TAP theory was derived assuming that the re- 
sulting free energy leads to a single (non-degenerate) 
stable thermodynamic state. That is, the TAP equa- 
tions (0} lead to a single physical solution that can be 
separated from nonphysical ones by finite energy gaps. 
We know, however, that this is not the case in the spin- 
glass phase. Hence the TAP free energy is internally 
consistent only in the high-temperature phase, where it 
leads to a single stable equilibrium state. One has to be 
more careful when extending the TAP approach to the 
low-temperature phase. There we cannot separate the 
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physical solutions of the TAP equations from the non- 
physical ones breaking stability condition We have 
to modify the TAP approach to situations with many 
quasi-equilibrium and unstable states degenerate in free 
energy. 

III. THERMODYNAMIC HOMOGENEITY AND 
MULTIPLE TAP STATES 

The existence of many solutions of the TAP equa- 
tions degenerate in free energy hinders the existence of a 
stable macroscopic equilibrium state and does not allow 
to perform the thermodynamic limit. In a degenerate 
case we cannot fix a single solution when enlarging the 
volume of the system and large fluctuation do not ex- 
tinguish in the thermodynamic limit. Different unstable 
solutions of the TAP equations degenerate in free en- 
ergy can be distinguished only by initial conditions, be- 
ing the only input to Eqs. (@J. This means that the TAP 
free energy is effectively not thermodynamically homoge- 
neous, since it does not depend only on spatial densities 
of extensive variables. One way to handle a multitude 
of quasi-equilibrium states in the TAP approach is to as- 
sume infinite barriers between different TAP states (in- 
dependence of different solutions of the TAP equations) 
and use Eq. We can, however, avoid assumption 
in that we do not a priori exclude interaction between dif- 
ferent TAP states. Since different solutions of the TAP 
equations belong in the beginning to independent sepa- 
rate parts of the phase space, we can introduce for each 
TAP solution its own replica of the spin variables and 
sum up thermal fluctuations for each solution separately. 
This is actually the concept of real replicas that has been 
used by the author to derive the RSB solution from the 



demand of thermodynamic homogeneity of the averaged 
free energy |19|. In the TAP approach without averag- 
ing over randomness we can give a transparent physical 
interpretation to real spin replicas. 

Let us assume that we have v different TAP solu- 
tions (distinguished by their history). Since different so- 
lutions are initially thermodynamically independent we 
introduce independent spin replica for each TAP solu- 
tion and replicate z/-times the original phase space. The 
partition function on this replicated phase space can 

be represented as [Tr e~ /3 - H ]' y = Tr„exp |/3 ^2 H a ^ — 

Tr„ exp {/? £ . J tJ S?S« + £ . Sf ) j , where each 

replicated spin variable Sf is treated independently i. e., 
the trace operator Ti v operates on the ^-times replicated 
phase space. The free energy of an z/-times replicated sys- 
tem is just ^-times the free energy of the non-replicated 
one, if it is thermodynamically homogeneous. We now 
break independence of individual spin replicas and add a 
small (infinitesimal) homogeneous perturbation breaking 
the replica independence AH([i) = Y^iY^ a <b ^^i^i- 
We could also break the replica independence inhomoge- 
neously by a site-dependent symmetry- breaking field 
Since the stability condition for the TAP theory, Eq. (J2J , 
is global, we are effectively able to break the replica de- 
pendence only globally as we demonstrate in the next 
section. 

It is not the field fi ab connecting different replicas that 
is of physical interest. We are interested in the linear 
response of the system to this perturbation. We derived 
|18| that after switching off the field \x ah the ^-times repli- 
cated TAP free energy reads 



1 t + (3J 2 Y,X a "M! 



a=l 



b=l 



/3J 2 N 



i E P4 1 1 - ( M ") 2 ] t 1 - ( M °) 2 ] - \ E Jv^M® 



a — 1 I i f v v 

E(* afc ) 2 \ - -fr E lnTr ex p i p 2j2 E x abs ? s * + ^E ( h + ) s " 



b=l 



(7) 



a<b 



In this expression local magnetizations M° and lo- 
cal internal magnetic fields rjf are configurationally de- 
pendent Legendre conjugate variational variables deter- 
mined from stationarity equations analogously to the 
TAP equations Apart from these parameters we 

introduced x ab , a ^ b, averaged overlap local suscep- 
tibilities representing a linear response to the replica- 
mixing field fi ab . They are global (translationally in- 
variant) variational variables, Legendre conjugates to 
the symmetry breaking fields fi ab . It is straightfor- 



ward to verify that at the saddle point we have x ah = 
n- 1 Y.i[{S?S$) T -{S?) T {S$) T ], where (. . .) T stands 
for thermal averaging. 

Free energy F v from Eq. (7J becomes independent of 
the replication index v and reduces to the TAP free en- 
ergy if x ab — 0- This is just the case when the con- 
vergence criterion for the TAP theory, Eq. (J5J), holds. 
A difference between the original TAP free energy and 
that from Eq. Q emerges only in regions with unstable 
states in the TAP equations. Free energy 10 can hence 
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be viewed upon as a general form of the TAP-like free 
energy for one configuration of spin couplings. Different 
replica indices correspond to different solutions of mean- 
field equations. Unlike the TAP approach the different 
states in free energy JJJ are allowed to interact via the 
overlap susceptibility x ab - 

If free energy F v is thermodynamically homogeneous 
it should not dependent on the replication parameter v. 
We already know that this is not the case, at least for the 
averaged TAP free energy, when stability condition J2J 
is broken [Tjj. If thermodynamic homogeneity is broken 
we have to use the new order parameters so as to restore 
this fundamental property. Only thermally homogeneous 
systems possess non-degenerate stable equilibrium states 
extremizing a free-energy functional and can be extended 
uniquely to infinite volumes. In our construction, it is 
the matrix of overlap susceptibilities that should restore 
thermodynamic homogeneity in the TAP approach. 

We now impose the condition of thermodynamic ho- 
mogeneity on free energy J7J in that we demand the ex- 
istence of a unique thermodynamic state. That is, all 
spin replicas must be equivalent and must lead to the 
same order parameters. This property can be quantified 
as follows 

M? = (S?) T = M, , (8a) 
X ah = X ba , (8b) 
{ X a \---,X av } = {x h \---,X h "} ■ (8c) 

Equation l|8a|) says that at the level of local magnetiza- 
tions different spin replicas are indistinguishable. That 
is, the internal local magnetic fields are replica inde- 
pendent, r/f = r\i. Conditions (|8b|) and ijHcl) restrict 
the matrix of overlap susceptibilities to be symmetric 
with rows (columns) being only permutations of each 
other. We remind that \ aa = 0- The matrix x ab con- 
tains then only v — 1 independent parameters, that 
can be cast into groups of identical values. If we set 
vk > VK-i > ■ ■ - v\ > 1 we may choose v\ — I-times a 



value xi, (y2 — ^i)-timcs an overlap X2, and so on up to. 
(vk — ^if-i)-times an overlap xk- 

As the last step we have to determine the structure of 
the matrix x ab with the above restrictions that would 
lead to an analytic free-energy functional of variables 
vi,...,vk and Xi) • • • ! Xk- The easiest way to deter- 
mine the most general available structure of x ab 1S to use 
a hierarchical construction. It starts with K = 1 and 
increases the number of different values of the overlap 
susceptibilities only if the solution with K different val- 
ues becomes unstable. In the case K = 1 the matrix of 
the overlap susceptibilities is uniquely determined by a 
multiplicity v\ of the only value xi- We examine this 
particular case in detail in the next section. If the theory 
with K = 1 is unstable, we build up a theory with K = 2 
values of the overlap susceptibility, xi and Xi- We as- 
sume that not only the individual replicas are equivalent 
but also blocks of replicas describing the solution with 
K = 1 are equivalent. That is, the diagonal elements in 
the solution with K = 1 are replaced by matrices v\ x v\ 
with zero on the diagonal and Xl on the off-diagonal po- 
sitions. The remaining off-diagonal elements in the so- 
lution with K = 2 are filled with the value xi- In this 
way we go on to higher hierarchies. We end up with 
an ultrametric structure of the Parisi RSB solution. It 
is of essential importance that the ultrametric structure 
allows for an analytic representation of the hierarchical 
free energy with K different values of the overlap sus- 
ceptibility. In fact, the ultrametric arrangement of the 
overlap susceptibilities x ab seems to be the most general 
structure in which the free energy is an analytic function 
of parameters xu v i f° r I = 1, • • ■ ,K. 

Inserting the ultrametric structure with K hierarchies 
of x ab in Eq. Q and after JT-times applied the Hubbard- 
Stratonovich transformation linearizing the spin vari- 
ables in the exponent of exp{/3 2 J 2 Y^ a <b X ab SfS\} we ob- 
tain an analytic representation of the if -level hierarchical 
generalization of the TAP free energy 



F K (XU"1, ...,Xk, vk) = ~\J2 ^U 1 ~ M ")(! ~ M D ~\H J H M i M j 



— Em 



1 K 

-0J 2 MiJ2(vi-vi-i)xi 



1=1 



PJ 2 N 



2_Jyi - n-i)xi + 9 xi 



K 



£>Ai { 2 cosh 



1=1 

K 



I h + r}i +^2\i^/xi - Xi+i 



1=1 



vk/vk-i 



(9) 



r 



We abbreviated VXi = dA/ e~ A '/ 2 / ' \/2tt and used vq — energy © should be an extremum with respect to ma- 
\,Xk+\ = 0. Notice that in our derivation v\ < v-i < trix x ab so that a thermodynamically homogeneous free 
. . . < vk = v and xi > X2 > ■ ■ ■ > Xk > 0. Free energy is produced. Thermodynamic homogeneity is 
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achieved in free energy 10 if it does not depend on i>k- 
This is equivalent to vanishing of xk- Since the trivial 
solution xi = always satisfies the stationarity equations 
for any I — 1, . . . , K, free energy @ with K hierarchies 
is thermodynamically homogeneous if xk = is the only 
physical solution of the respective stationarity equation. 
Nonexistence of a nontrivial solution for xk determines 
the number of hierarchical levels needed to achieve a glob- 
ally stable solution. 

Both sets of parameters xi and v i must be treated 
variationally and their physical values must be de- 
termined from respective stationarity equations. The 
equilibrium multiplicity factors vf q , determined from 
dFj^jdvi = 0, no longer need be integers, form an in- 
creasing sequence, and they even can be smaller than 
one. As discussed in Ref. the stationarity equations 
for vi have two solutions, uf 9 > 1 and uf 9 < 1. The latter 
case is actually the physical one, since it minimizes ther- 
modynamic inhomogeneity, if occurs. The value V\ < 1 
determines then a portion of the phase space (relative 
number of lattice sites) of one TAP solution influenced 
by the existence of other TAP solutions. With a homoge- 
neous, site-independent overlap susceptibility all spins in 
each solution are equivalent. The exponent vi then says 
that vN spins on average are influenced by other TAP 
solutions 

Free energy (0 is the most general analytic contin- 
uation of the TAP free energy to the low-temperature 
phase. If condition (J2J is obeyed for xi = 0,1 = 1, ■ ■ ■ , K 
and F k (x%,i'i,...,Xk,vk) = F TAP . Free energy F K 
is self-averaging and it is numerically identical with the 
RSB free energy with K hierarchical levels as derived in 
Ref. In the extension of the TAP theory, Eq. ©, 



the RSB order parameters are induced by thermal fluc- 
tuations and serve as mediators of interaction between 
different TAP solutions. 



IV. ONE-LEVEL HIERARCHICAL TAP 
THEORY 

Representation of a configurationally dependent 
free energy is rather complicated. It is a futile activity 
to try to solve the corresponding stationarity equations 
for a chosen configuration of spin couplings in full gen- 
erality before exploring suitable simplifications. More- 
over, it is not necessary to reconstruct the complete spa- 
tial distributions of site-dependent local magnetizations 
when we are interested in thermodynamic quantities de- 
termined by only lattice sums. Since free energy @ 
is self-averaging, in most situations we can replace the 
sums over the lattice sites by averages over the distri- 
bution of random spin couplings. Thereby we perform 
this averaging within linear response theory and with the 
fluctuation-dissipation theorem. That is, we use the same 
averaging rules to Eq. as used on Ftap in deriving 
the SK solution. This direct way of averaging of Fk leads 
to the Parisi solution with K hierarchical levels [wi IT^ | . 

To demonstrate explicitly that free energy © is a 
nontrivial extension of the TAP free energy in the low- 
temperature phase also for fixed configurations of spin 
couplings we resort our analysis of this free energy to the 
solution with K = 1, that is, to the one- level hierarchical 
solution. 



A. Stationarity equations 

It is straightforward to reduce the general expression for the hierarchical free energy Fk to the case K — 1 with 
Xi = X and v\ = v. We obtain 



i i a t2 at 



1,3 



1,3 



r ]i + -l3J 2 {v-l)xM i 



J) E ln / VX * I 2 c °sHP(h + KJ\/x + th)]] V ■ (10) 



Free energy Fi(x, v ) is represented in closed form and is obtain 
analytic in all its variables Mi, rji, x, and v. It reduces 
to the TAP expression if % = 0, which is the case when 
Eq J2J) is fulfilled by the local magnetizations Mi. 



Mi = (pW {h + m - A, x) t&nh[/3(h + m + A J^x)] ) 
magnetization follows from dFi/drji = from which we = (Pi , (Ha) 



The stationarity equation for the site-dependent local ^ 
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where 



(cosh v [l3{h + ni + \J^x)]) : 



(lib) 



is a density matrix. We denoted (X(X))\ = J T>XX(X). 

The internal local magnetic field rji is determined from 
dFx/dMi = which results in 



In addition to the site-dependent order parameters we 
have to determine the physical (stationary) values of the 
homogeneous parameters \ and v. From the equation 
dFi/dx = we obtain 



(12a) 



3 



JijMj-Mi 



/3J 2 (u-l) X + y0JU^-Mf) 



The multiplicity parameter v is derived from 
(11c) dFi(x, v)jdv — leading to an explicit equation 



N- 1 Y, t (lncosh[/3(/i + % + AJ^x)]) A - In (cosh"[/3(ft + m + XJ^x)}) 



l/u 



(3 2 J 2 



x(2Q + x) 
I 



(12b) 



where we denoted Q = N 1 £V M?. 



Global equations l|12[) complete local stationarity 
equations (|11|) . Free energy, Eq. Q1U[) . together with sta- 
tionarity equations l|ll|l and (|12|l dehne an analytic the- 
ory in the entire space of the input parameters. They 
reduce to the TAP theory in the high-temperature phase 
but generally differ from it in the spin-glass phase. The 
spin-glass phase is characterized apart from local mag- 
netizations also by two global parameters x an d v. The 
principal difference between free energy F\ and Ftap is 
in the A integral. This integration stands for thermal 
equilibration of the replicated spins, that is, for summa- 
tions of spin configurations in the phase space determin- 
ing other TAP solutions. Alternatively we can under- 
stand the A-integration as a thermally weighted averag- 
ing of the initial conditions for the TAP equations. Due 
to the dependence of TAP states on the initial conditions 
an additive homogeneous internal magnetic field XJy/x 
emerges. If the interaction between different TAP solu- 
tions (initial and final configurations of lomagnetizations) 
vanishes, x = 0, free energy F\ reduces to Ftap- 



There are also other situations, when F\ = Ftap- If 
v = 1, functional F\ is independent of x an d we recover 
the TAP free energy. The TAP free energy is recovered 
also in the limits v — > oo and v ~ * 0. In the former 
case the A-integration reduces to a saddle point at which 
v\ = r 2 < oo. We explicitly obtain the limiting v — > oo 



value of free energy 

A(r, A*) = ~ - M f) 

id 

+ \ E { y - ln [2cosh[/3(/ l + th + JTA,)]] | (13) 

being now a functional of Mi,Xi and T. At the saddle 
point Xi = (3JYMi and we find that dFi/dT = 0, that is, 
free energy F\ in the limit v = oo does not depend on T 
and we recover the TAP free energy. 

In the limit v — > the annealed randomness in the 
fluctuating field A reduces to a quenched one and the 
one-level hierarchical free energy reduces to 



a t2 at i 
F 1 (x,0) = !^— x(2- X )~-]>>4(l-A^)(l-M 2 ) 



m - l(3J 2 xM, 



\ E / PA * ln t 2 cosh -[P( h + Vi + \-tyx)]] ■ (14) 



In this representation we can absorb the fluctuating field 
Xi into the internal magnetic field r/i and add the Gaus- 
sian A-integration to the summation over the lattice sites. 
After the substitution £j = r/i + XiJy/x we find x = 1 — Q, 
where again we denoted Q = N^^Mf, and recover 
the TAP free energy. 
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It is clear from the above analysis that Eq. (|12b(l has 
always two solutions, one for v < 1 and the second for 
v > 1. In the former case it is a maximum of free en- 
ergy and in the latter one it is a minimum. We show in 
the next subsection that the solution for v > 1 is an un- 
stable extremum of free energy l|l(J[l and hence the only 
physically acceptable, stabilizing extension of the TAP 
free energy is that with v < 1. Free energy IjlUII offers 
a physical interpretation of the order parameters x an d 
v. The last term on the l.h.s. of Eq. i|l(J|) is the genuine 
interacting part of the free nergy. It is a local free energy 
due to Ising spins in a random magnetic field \3 \fx due 
to spin configurations of the replicated spins (other TAP 
solutions). The A- integral stands for thermal averaging 
of the replicated spins and the exponent v < 1 expresses 
a weight with which the replicated spins affect the local 
partition function. That is, effectively just vN spins are 
influenced by configurations of the replicated spins 



B. Stability conditions 

Saddle-point equations and l|12l) should lead to 
an extremum of free energy -Fi(x, v). The free energy for 
fixed homogeneous parameters % and v as a functional 
of only local magnetizations Mi, when Eq. Ijllc|l for the 
local magnetic field is used, should be a minimum. Only 
then the nonlocal susceptibility is positive semidefinite. 
The nonlocal susceptibility in the one-level hierarchical 
TAP theory is defined analogously as in the standard 
TAP theory and reads 



Or 1 ), 



J%3 



P 2 J 2 (1 - Q - (1 - u) X ) + — 



Xt 



(15) 



The local inhomogeneous susceptibility in tis case is 

2" 



Xt 



l-Mf-(l-v) 



a 



Pi i 



(16) 



The fundamental consistency condition (positivity of 
the spin-glass susceptibility) is Eq. I|6bjl with the local 
susceptibility \u from Eq. (|Po|) reads 



1 > 



(3 2 J 2 
N 



E 



l-(l-u) 



Pi ' 



If this condition is fulfilled free energy -Fi(x, v) from 
Eq. (|10|) is a physically acceptable and consistent solu- 
tion for local magnetizations Mi, homogeneous overlap 
susceptibility x an d multiplicity factors v. It is evident 
from Eq. I|17fl that if a TAP solution breaks condition @ , 
that is Eq. 1|17|) for v = 1, and we increase v to higher 
values we worsen the instability of the TAP solution. To 
improve upon the incurred instability of the TAP solu- 
tion we must evidently decrease the multiplicity factor 



v to values lower than one. That is, we have to max- 
imize free energy with respect to the matrix of overlap 
susceptibilities. 

If Eq. 117|) does not hold we are unable to find a stable 
equilibrium state that would not depend on initial con- 
ditions and would be separable from other macroscopic 
states by a finite gap in free energy. The degeneracy of 
the TAP free energy hence has not been lifted in free en- 
ergy (|l(Jfl completely. To improve upon this deficiency we 
have to go to a theory with a higher number of hierar- 
chies K > 1. It is evident that the two- level free energy 
^Mxi, v\, X2, vi) reduces to F\{xi v ) if either % 2 = or 
Xi = Xi- It is straightforward to demonstrate that break- 
down of condition i|17|) leads to an instability of equality 
X2 = and the second overlap susceptibility xi starts to 
peel off from its zero value. 

In the generalized TAP theory with local magnetiza- 
tions Mi, internal magnetic fields r\i and homogeneous 
overlap susceptibilities Xij v \i ■ ■ ■ > Xk j Vk as order pa- 
rameters, minimization of the TAP free energy w.r.t. 
local parameters does no longer play an essential role 
for stability of macroscopic states. This condition is re- 
placed in the hierarchical extension of the TAP theory 
by a more important condition, an extremum w.r.t. the 
homogeneous order parameters, overlap susceptibilities 
Xi with their multiplicities vi for I = 1,2, ... ,K. Ex- 
tremum of the hierarchical free energy w.r.t. homoge- 
neous parameters leads to an extremum in thermody- 
namic inhomogcncity of free energy. Since only v\ < 1 
lead to minimization of thermodynamic inhomogeneity, 
we have to maximize free energy to achieve the least inho- 
mogeneous state. Free energy F\ may hence also become 
unstable when the one-level solution does not maximize 
free energy and solutions with a higher number of hi- 
erarchical levels (different values for the overlap suscep- 
tibilities) produce a higher free energy. This happens if 
equation xi = Xi becomes unstable and a new value of 
Xi < Xi emerges. This happens if the following stability 
condition is broken 0] 



1 > 



(3 2 J 2 
N 



(P^\l-t*) 2 ) ; 



(18) 



Unlike Eq. (|17|) condition (|18|) gets stabilized with in- 
creasing v. In the TAP theory with \ — both condi- 
tions coincide. 

It is necessary that both conditions, Eq. (|17|) and 
Eq. (|18fl . are satisfied for the equilibrium values of all 
order parameters so that free energy I|1U|) leads to sta- 
ble thermodynamic states for almost all configurations 
of spin couplings. It depends on the equilibrium value of 
the parameter v which of these two conditions is (more) 
broken and hence responsible for the eventual instability 
of the one- level TAP free energy F\ . It is Eq. tnat 
makes the solution for v — > unstable, TAP free energy 
from Eq. (|T1J) . It is Eq. (|T7|) that leads to instability of 
solutions with v — * 1, TAP free energy ©. Note that in 
the averaged theory the relevant instability condition of 
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the extended TAP theory corresponds to the stability of 
the one-step RSB scheme. 



C. Asymptotic solution near the critical point 

Stationarity equations and (|12f> in full general- 
ity are difficult to solve for a hxed configuration of spin 
couplings. One can, however, investigate the behavior of 
the order parameters close to the spin-glass transition. 
In particular, one can explicitly confirm that the TAP 
solutions become unstable below the spin-glass transi- 
tion whenever condition J2J) is broken. We prove in this 
subsection that if Eq. J5J) is broken the overlap suscep- 
tibility x becomes positive and the multiplicity factor 
v G (0, 1) deviates from its equilibrium value from the 
high-temperature phase. 

The small parameter in the low-temperature phase is 
the overlap susceptibility. We hence expand all necessary 
quantities from stationarity equations into powers 
of x- We will need the two leading nontrivial orders. 
The asymptotic form of the local magnetization at the 
AT line reads 

M i = fa-p 2 J 2 {l-v)fa{l-fa 2 ) X 
+ /3 4 J 4 (l - v)fa{l - (i 2 ) [2 - v - (3 - 2v)fa 2 ] X 2 (19) 

where we denoted fa — tanh[/3(/i+rji)]. In expansion 119fl 
we assumed that the internal magnetic field is fixed, al- 
though its stationary value also depends on \, This de- 
pendence will be evaluated at the end of our calculations. 

The difference on the r.h.s. of Eq. I|12a|l must be ex- 
panded into first two orders in x- We obtain with the 
above notation 

(pr^) A -(^)'=^v 2 (i-^) 2 x 



We expand this function to 0(x 3 ) and use it together 
with Eq. 121|) for the evaluation of the expansion of both 
sides of Eq. fl2E)l . Using the program MATHEMATICA 
we end up with 

A = v X (2Q + x)-V = vX 2 {l- 1 J 2 <(1 - tf ) 2 ) av 



+ g/3 4 J 4 X <(1 - fa 2 ? [3-2u- (11 - 8i/)/i?] ) c 



(22) 



Before we proceed with solving the asymptotic forms 
of equations (|12a|l and l|12b(l we have to determine the 
%-dependence of the equilibrium value of the internal 
magnetic field r\i. It is sufficient for our purposes to 
expand this field only to linear power and we replace 
Vi ~ * Vi + XVi ■ The local magnetization changes accord- 
ingly 



fa = mi + (1 - m 2 )xPfii 



(23) 



where we denoted m, = tanh[/3(/i + nf)} the TAP lo- 
cal magnetization with the fluctuating internal magnetic 
field rfl determined by the TAP equation 14 b|) . We derive 
an equation for j3fji from Eq. I jllcj l. We have 



= a 2 j 2 



+ E [P Jij ~ 5r P 2 J 2 {l - Q)\ Mj . (24a) 



Further on, we obtain from Eq. I|19f) for Mi = dMi/dx 
an asymptotic relation 



M, 



(l-m^jji-^l-.K] . 



(24b) 



The equation for Q follows directly from expansion (12 1 1) . 

Combing the above equations and using the definition 
for the TAP susceptibility we come to a solution 



P 4 J\l - ^) 2 [2 - v - (8 - hv)v\\x 2 ■ (20) ^. ± p 2j2 {l _ v) 



We will need to expand the global parameter Q = 
N^ 1 J^i M 2 in Eq. Ijl2b|l . Also this parameter must be 
expanded to first two powers of x- We obtain directly 
from Eq. O 

+ /3 4 J 4 (l - v) (fa 2 (1 - fa 2 ) [5 - 3v - (7 - 5i/) fa 2 ] ) av x 2 

(21) 

where we abbreviated (Xi) av = N^ 1 ^2 i Xi. This nota- 
tion, originating in self-averaging property of local vari- 
ables, we also use in the following formulas. 
Next we denote 



— J2 [<mcosh[/3(/i +Th + AJVx)]> A 

-]n{cos)i u [(3(h + r h + \J s /x)}) 1 x /v 



in. 



2(3 2 J 2 



(mf(l-m?)> 



1 



av TAP 
3 



(24c) 



To reach a representation in closed form we have to 
evaluate sums with the linear susceptibility of type 
N^ 1 J^V ■,xTj f( m i)9{ m j)- We derive an explicit for- 
mula for such sums in Appendix iBl 

With explicit expressions for the sums with the non- 
local susceptibility we have at hand all necessary ingredi- 
ents to resolve the asymptotic forms of equations for the 
global order parameters near the critical point. We first 
use Eq. HBllfl to evaluate 

<d-M 2 ) 2 L 

= ((1 - m 2 f) av - 4 ((1 - mlfm^) ^ x 
= ((1 - m 2 f) av + 4/3 2 J 2 (l - v) (mt(l - m 2 )) av X 
- 8/3 4 J 4 <m 2 (l - m 2 )) av <m 2 (l - m 2 ) 2 ) m x (25) 
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With this result the asymptotic form of the equation for the overlap susceptibility reads 
I 



/3 2 J 2 ((1 - m ff) av - 1 = /3 4 J\{ ((1 - mf) [2 - v 2(5 - 3^)m 2 + (4 - v)mf]]) av 

+ 8/3 2 J 2 (l - u) (m 2 (l - m})) av <m 2 (l - m 2 ) 2 ) Qu } (26) 

while the equation for the multiplicity factor v can be rewritten to 

/3 2 J 2 ((1 - m 2 ) 2 ) au - 1 = \^J\{ <(1 - m 2 ) [3 - 2u - 2(7 - hv)m\ + (5 - 2u)mf]}) av 

+ 12/3 2 J 2 (l - v) (m 2 (l - m \)) av <m 2 (l - m\f) m } . (27) 
I 



Both equations (|2*S|) and (|2*7|) are in fact defining equa- 
tions for the overlap susceptibility %. Left-hand sides 
of both equations are identical and become positive in 
the low-temperature phase when condition @ is broken. 
Since the solutions from both equations must lead to the 
same unique value of x we have to equal right-hand sides 
of these equations. As a result we obtain an equation for 
the value of the parameter v along the AT line of critical 
points. Its solution reads 

. 2(m 2 (l-m 2 )V 
V= (d-m f)3) OT • (28) 

Parameter v obtained from Eq. (|28|l is the limiting value 
of the low-temperature solution at the AT line. It is 
positive at finite magnetic field. This causes no prob- 



lem, since we know that the high-temperature solution 
obeying the consistency condition (0) is independent of v 
(thermodynamically homogeneous). To determine the 
deviation of v from its value at the AT line in the spin- 
glass phase we had to go to higher orders of the expansion 
in x- 

With the above solution for the multiplicity factor 
we can use either Eq. 126|) or Eq. I|27() to determine the 
overlap susceptibility x- The solution for this parameter 
is physical only if the r.h.s. of Eqs. I|2fci|) and (|27|) is 
positive. We can conclude already from Eq. I|28|l that 
this cannot be the case down to zero temperature along 
the AT line. The geometric parameter v must be smaller 
than one. We have a critical value v c of this parameter 
at which the r.h.s. of Eqs. (|26() and i|27|) vanish, namely 



V r .=2 



((1 - m?)(l - 3m 2 )) a „((l - m 2 )(l - 3m 2 + 2mf)) c 



((1 - m 2 )(l - 4m 2 ))L - (mf (1 - m?))((l - m?)(l - 2m 2 )) Q „ + (mf (1 - m»))((l - m?)(l - 9m 2 )) £ 



(29) 



Using the solution for v from Eq. I|28() on the l.h.s. of 
Eq. (|29(l we obtain an equation for a critical value of the 
magnetic field (temperature) above (below) which the 
above asymptotic solution breaks down and we have to 
go to higher-order terms in the expansion in the overlap 
susceptibility. We hence experience a crossover in the be- 
havior of the homogeneous order parameters along the in- 
stability (AT) line if we go to high magnetic fields. While 
in low magnetic fields the overlap susceptibility is deter- 
mined from a linear equation l|26(l . we have a quadratic 
equation determining the leading asymptotic term near 
the AT line in high magnetic fields. The instability of the 
TAP equation in high magnetic fields is a rather complex 
task and will be presented in a separate publication. 



V. SUMMARY AND CONCLUSIONS 



We analyzed the low-temperature thermodynamics of 
mean-field models of spin glasses. In particular, we con- 
centrated on the behavior of thermodynamic potentials 
for individual configurations of spin couplings. For this 
purpose Thouless, Anderson, and Palmer proposed a con- 
struction of a configurationally-dependent free energy of 
the Sherrington-Kirkpatrick model. The derivation of the 
TAP free energy is, however, valid only if a convergence 
or stability condition J5J is obeyed. Typical configura- 
tions of spin couplings in the spin glass phase either do 
not allow for solutions of the TAP equations satisfying 
this condition or produce a multitude of solutions de- 
generate in free energy macroscopically many of which 
break Eq. @. This situation naturally evokes a number 
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of questions about the TAP construction: 1) Is it com- 
plete? 2) Does it produce stable equilibrium states? 3) 
Does the thermodynamic limit exist? Finally, we know 
that the exact solution of the SK model is the Parisi RSB 
scheme. The order parameters introduced by the replica 
trick are not manifested in the TAP thermodynamic po- 
tentials. Hence, we should answer another question: 4) 
At what stage do the RSB order parameters emerge? 

Presently, it is predominantly assumed that the TAP 
theory is complete as it is and contains all necessary order 
parameters from which we can construct the exact solu- 
tion. It does not produce a single equilibrium state, but 
rather exponentially many locally stable and unstable 
states separated by infinite energy barriers and (almost) 
degenerate in free energy. Hence a weighted sum Q of 
local free-energy minima is to be taken into account to 
construct a global equilibrium state with which we can 
construct the thermodynamic limit. The only informa- 
tion missing in the TAP thermodynamic potentials is the 
complexity, i. e., the number of available TAP states, lo- 
cal minima of the TAP free energy. There is, however, no 
trace of the RSB order parameters in the TAP construc- 
tion and they are introduced only in course of averaging 
over the quenched randomness in spin couplings. 

In this paper we proposed alternative answers to the 
above urgent questions about the TAP construction and 
its relation to the RSB order parameters. We explicitly 
demonstrated that the TAP free energy for situations 
with broken stability condition (J2J is unstable The TAP 
approach becomes incomplete and must be enriched by 
new order parameters. The necessity for the enhance- 
ment of the TAP construction emerges due to the need 
to lift degeneracy in the TAP free energy that cannot 
separate stable from unstable states. Unlike the exist- 
ing approaches we do not need to assume impenetrable 
energy barriers between different TAP states. We al- 
low for energy flows between these states if it is ther- 
modynamically convenient and if it leads to stabilization 
of equilibrium states. The energy flow between them is 
mediated and controlled by new homogeneous order pa- 
rameters, overlap susceptibilities. These additional order 
parameters are determined thermodynamically from sta- 
tionarity equations so that to achieve a thermodynam- 
ically homogeneous free energy with (marginally) sta- 
ble equilibrium states. The overlap susceptibilities in- 
troduced in the proposed extension of the TAP construc- 
tion of a configurationally-dcpcndcnt free energy are di- 
rectly related to the Parisi RSB order parameters. They 
coincide after averaging over spin couplings. Since the 
configurationally-dependent free energy with overlap sus- 
ceptibilities is self-averaging, averaging over randomness 
is performed within linear response theory and with the 
fluctuation-dissipation theorem as in the case of the SK 
solution. 

We demonstrated in this paper that the TAP con- 
struction is incomplete in the low-temperature phase, 
the TAP states are unstable and decay into a compos- 
ite state described by inhomogeneous local magnetiza- 



tions and homogeneous overlap susceptibilities. The ex- 
tended free energy from which the physical values of the 
order parameters are determined is self-averaging with a 
well defined equilibrium state and thermodynamic limit. 
The RSB order parameters, the overlap susceptibilities, 
emerge due to thermal fluctuations as mediators of in- 
teraction between different TAP states. Averaging over 
randomness is harmless and does not change the struc- 
ture of the phase space of the order parameters. 

When compared with the existing treatments of the 
thermodynamic behavior of spin-glass models we can 
conclude that the hierarchical TAP free energy © re- 
duces to the TAP one for equilibrium states described by 
local magnetizations satisfying condition |(SJ|. The pro- 
posed extension of the TAP construction may then seem 
redundant, since only TAP solutions being local minima 
satisfying Eq. J3J) are physically relevant. It is, however, 
not the case. The proper analytic continuation of the 
TAP approach to unstable states guarantees a consis- 
tent description of all states without a tedious way of the 
separation of locally stable and unstable solutions of the 
TAP equations. Moreover, the interaction between the 
TAP solutions introduced by the overlap susceptibilities 
changes the structure of the underlying phase space and 
the value of free energy. The hierarchical TAP theory 
does not require solving numerically the TAP equations 
for typical configurations of spin couplings in finite vol- 
umes or to calculate the complexity of the TAP theory. 
To determine thermodynamic properties of the SK model 
we can directly average the configurationally-dependent 
free energy in the thermodynamic limit, which is a sig- 
nificant simplification. 
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APPENDIX A: SPIN GLASS SUSCEPTIBILITY 
AND THE RESOLVENT 

The averaged local susceptibility x and the spin-glass 
susceptibility xsg can be derived from the resolvent con- 
structed from the inverse nonlocal susceptibility. The in- 
verse of the nonlocal susceptibility is a second derivative 
of free energy and can generally be represented as 



= ".J + % — + E P4xjj ■ (Al) 
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The resolvent for a complex energy z (scaled by (3 in the 
same way as the inverse susceptibility) is defined 



G{z) = -Tr[zl- X ~ 1 



(A2) 



The averaged local susceptibility and the spin-glass sus- 
ceptibility can be derived from the resolvent as 



X = 



XSG 



N ^ 



ij 



Xii 



dG(z) 



dz 



(A3a) 
(A3b) 



In the Sherrington-Kirkpatrick model we have 
Y,jP 2 JijXjj = P 2 J 2 X = -P 2 J 2 G(0). We now use 
a theorem of Pastur [2(j for the resolvent of matrices 
with off-diagonal elements being Gaussian random 
variables with variance J 2 /N. When applied to the 
inverse susceptibility we obtain for AG(z) — G(z) — G(0) 



AG(z) 



— V- 

N ^ 1 



xUz-P 2 J 2 AG(z)) 



X u(z-P 2 J 2 AG(z)) 



(A4) 



Using the definition of the spin-glass susceptibility 
Eq. (|A3b|) we obtain 



-y- 

N ^ (1 



(l+/3 2 J 2 AG(0) Xl 



XSG 



^ 1 



(A5) 



N 



(l + /? 2 J 2 AG(0)x^) 5 



Assuming continuity of the resolvent at origin z = we 
have AG(0) = and we end up with representation (l(jal) . 

Note that the resolvent representation (|A4|) does not 
exclude a nontrivial solution for AG(0). Setting z = in 
Eq. (EH we obtain an equation 

AG(0) = /^AG(0) A J2 1 + ^l G{0)Xit ^ 

allowing for a nontrivial solution if the stability condi- 
tion @ is broken. This nontrivial solution was used by 
Plefka in Refs. 0, in his extension of the TAP the- 
ory. If we choose the nontrivial solution for AG(0) dic- 
tated by analyticity of the resolvent in the complex plane, 
the spin-glass susceptibility is no longer represented by 
Eq. H6a|) but rather by Eq. i|A5(l and remains positive 
in the spin-glass phase. The new parameter AG(0) > 
cannot, however, be derived from a free energy and does 
not possess a diagrammatic representation. It is not a 
proper symmetry-breaking order parameter of a micro- 
scopic origin. Moreover, with this parameter we break 
continuity of the resolvent and 



lim GO) ^ G(0) 



(A7) 



The last equality is the definition of the averaged lo- 
cal susceptibility, Eq. (|A3al) . The discontinuity makes a 
physical interpretation and explanation of the order pa- 
rameter AG(0) difficult. We can only observe that posi- 
tivity of AG(0) formally expresses a deviation from the 
fluctuation-dissipation theorem. There is no evidence or 
indication that the TAP solutions really lead to a discon- 
tinuous resolvent and AG(0) > in the spin-glass phase. 
An alternative way how to reach thermodynamic consis- 
tency and positivity of the spin-glass susceptibility within 
a microscopic construction provided by the hierarchical 
free energy with a fluctuation-dissipation theorem in the 
extended phase space with real spin replicas is offered in 
this paper. 



APPENDIX B: SUMS WITH THE NONLOCAL 
MEAN-FIELD SUSCEPTIBILITY 

The mean-field approximation is a single-site theory 
in that it effectively decouples distinct lattice sites. The 
decoupling of distinct lattice sites leads to a simplifica- 
tion of sums with nonlocal functions. These sums can be 
converted in the mean-field theory to uncorrelated lat- 
tice sums with site-local functions. Correlation between 
different sites enters mean-field expressions only via ho- 
mogeneous global parameters being again uncorrelated 
sums over lattice sites. 

In the spin-glass mean-field theory we are interested 
in sums with the nonlocal susceptibility of form 

C[f,g} = i^xy/WsK) (Bi) 



The only nonlocal term in the susceptibility is the spin 
exchange f3Jij. It is the off-diagonal part of the suscep- 
tibility that makes the evaluation of sums from Eq. (|B1|) 
difficult. We hence use the following representation for 
the nonlocal susceptibility 



Xij — Xii 



Xkj 



Xii i Xv 



kj 



+ ^ ^2 PJikXkk/3JkiXuf3Jij + 
k^j i^i 



Xn (B2) 



where the primed sum does not allow for repetition of site 
indices. It means that only self-avoiding random walks 
contribute to the inverse matrix in the formal solution to 

Eq. rea . 

Representation l|B2|) can easily be proved by a dia- 
grammatic expansion when the definition of the TAP sus- 
ceptibility (JSJ is used. We successively exclude repeating 
site indices in the multiple sums of the expansion for the 
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inverse of the r.h.s. of expression (J3J). The diagonal ele- 
ment of the susceptibility xu was determined along this 
line e. g. in Ref. 

Since the site indices in Eq. (|B2|) are decoupled we 
can use the following functional representation for the 
spin exchange of the SK model 



(B3) 



(3 2 J 2 

13113 = "Iv" ^ Vimj + m ' iV ^ 



We denoted Vj = xud/dmi. Representation (|B3|I is a 
consequence of the fact that just squares of the spin cou- 
pling Jij contribute to the sum C[f, g]. The paired spin 
exchange to the given one Jy connecting lattice sites i 
and j can be extracted from the end-point functions of lo- 
cal magnetizations m t and/or mj. A more detailed proof 
of Eq. CB3j) can be found in Ref. [3. 

Using Eq. I|B3|1 we can represent the off-diagonal sus- 
ceptibility Xij = Xij ~ XiAj as 



f3 2 J 2 
N 



Xij 



{V,\„;// ; \ ;; + miXii^iXjj 



-ViX 4 



iXiiYj] (B4) 



where we denoted global parameters Xj = J2 k m kXkj 
and Yj — J2 k ^kXkj- Note that the differential operator 
V, acts to the right on functions of the local magne- 
tization mi only. The lattice sums in the definition of 
the global parameters Xj and Yj should avoid the fixed 
index j. In the mean-field approximation we can ne- 
glect this restriction, since the difference is only of order 
OiN- 1 ). 

It is straightforward to find from Eq. l|B4fl an equation 

for 

Xi = fi 2 J 2 {(V ' k m k Xkk) aviriiXii + (m 2 k Xkk) «V \xa 

+(V 'kirikXkk) avXi + (mlxkk) av Yi} (B5) 

where we denoted as in the main text (Xk) a v 
X Xk- Analogously we find 

Y l = f3 2 J 2 {(V fc V kXkk) avrriiXu + (V 'kmkXkk) av^iXu 
+ (V fe VfcXfefe)ai,A. i + (V k m k Xkk) avYi} . (B6) 



To represent the solution for these parameters con- 
cisely we denote I = j3 2 J 2 ((l — m 2 ) 2 ) av and r — 
(3 2 J 2 (m 2 {l-m 2 )) av . Then 



v = (1 2r)miXu + rViXu ^ 



and 



Yi = (21 - r) 



(1 - I) 2 + 2r(2 - I) 



-2mjXii + (1 - QViXj 
(1 - I) 2 + 2r(2 - I) 



(B8) 



Inserting Eqs, (|B7|) and (|B8|> in Eq. (|B4|) we obtain 



Xij — Xii^ij "I" 



I3 2 J 2 



N [(1 - I) 2 + 2r(2 - I)] 
x {(1 + 2r - /) [ViXumjXjj + miXiiVjXjj] 
-2(l-2r)miXumjXjj +rViXuVjXjj} • (B9) 
Equation (|B9(I hold only in the leading N^ 1 order. Hence 
the second term on the r.h.s. contributes only to the 
off-diagonal part and to lattice sums with the nonlocal 
susceptibility. 

This representation is still a rather complicated ex- 
pression. Fortunately, we need to know for our purposes 
the nonlocal susceptibility only along the AT line for 
which 1=1. In this case the nonlocal susceptibility re- 
duces to 



Xij Xii^ij 

/3 2 J 2 



2N 



[2ViXtirrijXjj + 2rrnxiNjXjj + ^iXu^jXjj] 



((l-m 2 (l-3m 2 )) av 
(ml(l-ml)) av ((l-mtr) c 



(BIO) 



Using this result for functions f(rrii) = mj(l — m 2 ) and 



g(rrij) = rrij in Eq. i|Bl|) we find an explicit representation 
for a sum with the nonlocal susceptibility at the AT line 
needed in Eq. 



1 £ Xij mi(l - mDraj = ^f- ((1 - m 2 ) 2 ) m ((1 - rn 2 )(l 3m 2 )) c 

ij 



(Bll) 



r 



Notice that the nonlocal susceptibility IjBQjl diverges at field where r = 0. 
the critical point of the SK model only at zero magnetic 
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